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Evaluation of Candidate 
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PREVIOUS PART-TASK SIMULATOR EXPERIMENT: 
COMPARISON OF PRESENTATION MODES (6/89) 
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Post-session debriefing 



PRESENTATION MODE COMPARISON: RESULTS 
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Verbal Textual Graphical Verbal Textual Graphical 

Presentation Mode Presentation Mode 






ADVANTAGES OF GRAPHICAL MODE OF PRESENTATION 


0 

0 

£ 

0 


5 

O 

O) 

c 

s 

GO 

■D 

a> 

6 

0 


0 

</) 

c 

o 

Q. 

CO 

0 


o -5 


0 

> 

v* 

"c/5 

o 

a 

& 

0 

> 


CO 

0 

T3 

O 

E 

U_ 

0 

•*-* 

O 

O 

•*—> 

o 

0 

CL 

0 

0 


"O 

0 

O 


o 

£ 

“O 

0 

0 

0 

8 

o 

0 

D 


w 

0 

3 

E 

k_ 

0 

■4— » 

O 

c 

0 


0 

i 

-Q 

■D 

0 


0 

"O 

C 

0 

5k 

O 

0 

V— 

D 

O 

0 
0 

O) 

c 

lid 

0 

E 

1 

c 

o 

*0 

‘o 

0 

Q 


0 

0 

-C 

o 

0 

2 

a. 

a. 

0 

"O 

0 

0 

0 


0 

"O 

c 

0 
-♦— > 

0 

i 

C 

o 


8 . z 

M> rn 


0 

0 

O" 

0 

v- 

T3 

C 

0 

C 

_0 

CL 

O 


0 
■*— * 

_o 

Ql 

"O 

0 

£ 

o 


O 0 
C 0 
~ 0 


Q. 

CL 

0 

E 


0 

0 

*0 

C 

8 


_0 0 


0 


0 

> J 

IE "0 
c c 
o> o 
o *= 

O 0 

5 -i 

g "0 

C CO 
2 0 

c- O 
+= k 

5 E 


c 

o 

’0 

c 

0 


0 

- 1 
£ i 

0 'T 
■— 0 
t: -o 

S g. 

■§. «> 
0 

<5 


884 



GRAPHICAL MICROBURST ALERT EXPERIMENT: OBJECTIVES 
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~> Positional information is now present 


GRAPHICAL MICROBURST ALERT EXPERIMENT: OVERVIEW 
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CONTROL DISPLAY UNIT 











CANDIDATE DISPLAY DESIGN 
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DISPLAY A: "FUSED" ALERTS 



Solid red shape 
'hazardous" microburst 







DISPLAY B: "FUSED" ALERTS + INTENSITY 



Solid red shape 
Level 2 microburst 
"hazardous" 












EXPLANATION OF F-FACTOR CRITERION TO PILOTS 
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Pilots were receptive to this explanation 


DISPLAY C: "DISCRETE" ALERTS 



hazardous" microburst, 
ground-based sensor 
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RESULTS: VISUAL CLARITY OF ALERTS ON EHS 
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MB Display 

Display A: “Fused” data, single intensity level 
Display B: “Fused” data, three levels of intensity 
Display C: “Discrete” data, single intensity level 



RESULTS: OVERALL RANKINGS 
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Display C: “Discrete” data, single intensity level 
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RESULTS: NEED RANKINGS OF DISPLAY FEATURES 
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Mean Need 
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ompare with current TDWR “wind shear with loss” alerts 



PROCEDURAL IMPLICATIONS OF GRAPHICAL ALERTS 
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Presenting the information graphically would explain to the pilot the 
“nuisance alerts” generated when microburst is off the flight path! 



CONCLUSIONS AND RECOMMENDATIONS 
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Current work: development of a data-level algorithm for multi-sensor 
microburst hazard assessment 



OVERVIEW OF ALGORITHM 
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Can be used with multiple microbursts 

Currently testing with simulated microburst winds: will be tested on real 
data in the future 



Experimental Evaluation of Candidate Graphical Microburst Alert Displays 

Questions and Answers 


Q: Unknown - Did you look at the cases where perhaps where there was a disagreement 
between ground based information or airborne sensor data? 

A: Craig Wanke (MIT) - We did not. That is actually one of the major points. For the data 
fusion cases we showed two icons that were essentially overlaid. Clearly there is a significant 
problem if those do not line up. If you have a computer algorithm that attempts to interpret that 
in a realizable way, that is probably more effective than showing the pilot the two non agreeing 
icons on a three mile final and asking him to figure out what is really going on. That is really one 
of the biggest arguments for data fusion. But, that is something that we could not really test in 
our experiment. 

Bob Hall (Airline Pilots Association) - 1 don't have a question, but I wanted to find the 
appropriate time to make a comment to the group here. This looked like it might be a good time 
to do that. I wanted to offer a few words of encouragement and motivation to the industry from 
the ultimate end user, which are the pilots. As you are probably aware, ALPA has been very 
active in this whole wind shear endeavor for probably over ten years, even before some of the 
major accidents occurred. We would like to think that we were instrumental in getting some of 
the FAR changes which mandated the reactive devices that are going into our cockpits now. We 
are very thankful to be getting these reactive devices into our cockpits. As nice as the reactive 
device is, we kind of view it as a nice back up. What we would really like to have is a predictive 
systems, which is what we are talking about in this conference today. A few years ago we were 
very concerned that even though we had gotten the reactive devices mandated, we were 
concerned that the industry would drop all the research and development on the predictive 
devices. We were concerned that in endorsing those changes we might lose out in what we really 
wanted. I am just here to emphasize and motivate you to keep up the good work. We are very 
glad to see the progress that is being made, especially in the Doppler radar. I was a little 
discouraged several years ago about the clutter problems. It looks like those have been really 
overcome and now we are pressing on to talking about how do we get the information to the 
cockpit. So please keep up the good work, and be assured that pilots do want accurate, reliable, 
predictive systems that will help us to avoid the wind shear hazards. 

Q: Howard Williams (Gulfstream Aerospace) - 1 believe we can echo what has just been 
stated. Relative to your pilot evaluation, did you have any FAA pilots as part of the team? 

A: Craig Wanke (MIT) - No, we did not. These were all airline pilots. 

Q: Howard Williams (Gulfstream Aerospace) - Do you feel that these types of displays are 
certifiable or have you reached that stage yet? 

A: Craig Wanke (MIT) - We haven't really reached that stage yet. We haven't thought 
seriously about the certifiability issues. 
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John Hansman (MIT) - We see what we are doing more as baseline work. We are not trying to 
certify a specific display, but provide baseline data on the utility of these type of disp’ny concepts. 
As you go into a particular display configuration there will be certiftability issues. These were not 
designed to be certified displays. 

Q: Sam Shirck (Continental Airlines) - Did you make any studies that involved TCAS on your 
displays? 

A: Craig Wanke (MIT) - No we did not. 

Sam Shirck (Continental Airlines) - 1 would encourage you, if your marching orders permit, to 
look at an independent display for hazards such as TCAS and wind shear. As much as I like to 
see wind shear on a moving map, I don't think we can put much more on an EHSI than we have 
right now. If you have ever ridden in the cockpit going into the Denver area, and watch what 
happens on the TCAS system on an EFIS, it is very exciting. Although the engineering is capable 
of putting all this stuff on there, I am not sure that we as pilots can get it off and use it. TCAS is 
a very important part of this whole display issue. I would encourage you to investigate a 
dedicated display for hazards and to involve the TCAS scenarios in that. 

A: Craig Wanke (MIT) - That is certainly a consideration and that is something that probably 
should be worked on, but I don't know that we have any plans to do TCAS studies. We arc doing 
some similar stuff with terrain alerting displays. 

John Hansman (MIT) - That is a very valid point. The whole issue of display clutter and display 
priority is a critical issue for this, for data link, for a whole bunch of areas. What do you do when 
you have two high priority messages that over write? Craig alluded to the fact that we are doing 
a second experiment which was a terrain alerting experiment with a separate dedicated terrain 
alerting display. As you are aware there is a display space availability problem in the cockpit. 
There is also a second problem, which is if you have a short term critical alert you do not want the 
crew to go heads down to evaluate the threat and resolve it. So you go into this trade off of 
where do you want the crew looking. We understand the issue. We didn't include TCAS because 
of experimental difficulties, not because we do not think it is a problem. 

Pat Adamson (Turbulence Prediction Systems) - 1 encourage everybody to look at the S7 ARP 
wind shear document. There is a lot of work going on with that committee on displays with 
regard to short look and longer look predictive systems. In fact, there is a draft out of a display 
concept. I think that the entire community should be looking at that as well as studies of such 
displays. Clearly there are several types of wind shear systems being considered from short look 
to longer look. I guess I would encourage you to take a look at that document as part of your 
studies. 
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